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Abstract. We give a new proof of a priori estimates of Gidas-Spruck type for the nonlinear 
elliptic equation with square root of the Laplacian. We also use the approach to establish a 
priori estimates for the system of the Lane-Emden type involving a fractional Laplacian. 



1. INTRODUCTION 

We consider the nonhnear problem: 

in ri, 

on an, (1.1) 
in r2, 

where SI is a smooth bounded domain of M" and A1/2 is the fractional Dirichlet Laplacian 
((—A) In)'' on the domain with s = i. The Dirichlet Laplacian with a suitable domain is 
selfadjoint and has a discrete spectrum with eigenvalues of finite multiplicity. Then it admits a 
orthonormal eigenbasis and the fractional Laplacian is then defined by functional calculus using 
the spectral theorem. 

The study of the problem (jl.ip was initiated by Cabre-Tan |CT| . They converted the nonlocal 
problem (|l.ip to a local problem on a half-cylinder C := ft x [0, 00): 

At; = in C = 1] X (0,00), 

V = on OlC :— dfl x [0, 00), 
1^ = f{v) onQx {0}, 

V > in C, 

where i/ is the unit outer normal vector to C at SI x {0}. The trace u of w on S7 x {0} is a solution 
of (|l.ip when w is a solution of (|1.2p . 

By studying the local problem (|1.2p with classical local techniques, Cabre-Tan |CTj established 
existence of positive solutions for problem with subcritical power nonlinearities, regularity, sym- 
metric property. They also prove a priori estimates of Gidas-Spruck type by a blow-up argument 
along with proving a nonlinear Liouville type result of the square root of the Laplacian on the 
half-space (see |CT[ Theorem 1.3]). 

The first aim of this paper is to extend the result of Cabre-Tan [CT] on a priori estimates to 
functions satisfying a general condition by giving a new proof. 

Theorem 1.1. Let n > 2 and 2^ — -22-. Assume that C K" is a smooth bounded domain and 

— n — l 



f{u) ^uP, 1 < p < 2» - 1 - 2+1 



n-l ■ 
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Then, there exists a constant C{p, Q) depending only on p and such that every weak solution 
of (1.1) satisfies 

\\u\\L^^n)<Cip,n). 

Moreover, the above statement holds for locally Lipschitz continuous function f : — >■ R satsifying 

M ^ \l/2 /(^ 

with one of the following assumptions 
(1) is convex and 



liminf > Ai , lim , ...w. — tt = 0, 




limsup "^^"^^^ ^ 0' ■'^"'"^ ^ e [0'2* = (1-3) 

ri->oo U^fiuy/^ n~l 

(2) Condition (jl.3l) /loMs anii the function u f{u)u^ "-i is nonincreasing on (0,00). 

The main step of the proof is to get the uniform bound j^-^u'P^'^{x)dx < C{p,ft) from the 
Pohozaev identity of Tan [T] given for solutions of (|1.2p . Then, we shall use a bootstrap argument 
with the LP — estimates for the problem 

r (-A)^. = / inn, 
1 u = on dfl. 

This estimate will be proved by using the bound of the Green function of (—A)* obtained by Song 

Our approach is a nonlocal version of the method of Figueiredo-Lions-Nussbaum |FLNj for the 
problem 

uP in r2, 

on dn, (1.5) 
in 51. 

The first step of this approach is to use the moving plane argument to get the L°° bound of u near 
the boundary dft. The moving plane argument for (jl.ip is achieved in |CTj . Therefore this step 
is done without difficulty when J7 is strictly convex. However, we have more work to derive the 
bound J^^uP'^^dx from the Pohozaev identity for a solution v of (|1.2p . It is due to the non-local 
nature of the Pohozaev Identity in view of its trace function u = TrQx{o}'^- More precisely, we can 
not control the left side of the Pohozaev identity (see formula (|3.6p ) by only using L°° estimates 
of u near the boundary in contrast with the case for the problem (|1.5p . We shall overcome this 
difficulty by a suitable partition of v and an estimate using a Green function related to the equation 
(|1.2[) . This approach does not need a Liouville-type result, and so the function / is not required 
to have a precise asymptocity as u — > 00. It is also useful to study the system type problems. 
The second part of this paper is concerned with the following system: 

^1/2"" = ^P in C, 
= ui in C, 
u > 0, V > in C, 
u = V = on dC. 

The analogue problem to (|1.6p for the Laplacian is the Lane-Emden system, which has been 
investigated widely in the last decades (see |QS| and references therein). We shall prove the 
following theorem on a priori estimates of this system. 
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Theorem 1.2. Assume that f2 C M" is a smooth convex bounded domain andp,q > 1 satisfy the 
condition, 

1 1 n-1 
> . 



p+1 q+1 

Then, there exists a constant C{p,q,il), which depends only on p and fl, such that every weak 
solution of (|1.6p satisfies 

+ < c{p,q,n). 

This theorem is analogues to the result of Clcmcnt-Figuciredo-Mitidieri |CFM| for the Lane- 
Emden system with the usual Laplacian. As a preliminary step of the proo. we shall obtain a 
Pohozaev type identity and exploit the moving plane method for the system (|1.6p . 

This paper is organized as follows. In Section 2, we first review on the function spaces related 
to the fractional Laplacian and their properties. We then recall some results of Cabre-Tan |CTj 
and prove the — L'^ estimates. In Section 3, we prove several lemmas and use them to establish 
the proof of Theorem ll.il In Section 4, we obtain the Pohozaev Identity and exploit the moving 
plane method for the Lane-Emdcn system (|1.6I) . Based on these things, we shall finally complete 
the proof of Theorem 11.21 

We shall use the notation < when the constant of an estimate A < CB depends only on the 
fucntion /, the domain and some parameters fixed in the proofs. 

2. The Functional Frame Work 

This section is devoted to study the fractional Laplacians and related function spaces. Consider 
L^(ri) normalized eigenfunctions ipi, (t>2, (t>3j ' ' ' lOf —A, corresponding to positive eigenvalues Ai < 
A2 < A3 < ■ • • , counted with multiplicity. We then have > and 

n 

For each r G M we define the fractional Laplacian in the following way: 

oci 00 

k=l k=l 

with domain 

00 00 

:= {u = : E^'fc^fe < 

k=i fc=i 

By the correspondance 

00 

fe=i 

the space Ho(f^) is identified with a subspace of l°°, 

00 

fe=i 

which is a Hilbert space with the inner product 



itv)r = ^K£.kVk- 
k=l 
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We see that (—A)" : Hq ^^(fi) is an isomorphism. Define the bihnear operator 

As{u,v) ~ J^{—A)^u{x)v{x)dx. Then we have for u — X^fcLi ^fc'/'fc and v = Y^=\ Vk4>k that 



fc=i fe=i 

By Cauchy- Schwartz inequaUty we see 

1/2 I- CX3 ,.1/2 



Thus the bihnear operator As can be defined on the space x for any r S E. This fact 

ahows us to use As in different sobolev spaces in the variational argument for proving the existence 
of nontrivial solutions to the Lane-Emden system (see jH Vj ) . The sobolev embedding is given by 

Hl{n) ^ LP{n), if 1 < p < j;^^, < oo, 2r < N. 

This embedding is compact if 1 < p < 2N/{N — 2r). If 2r > N, these properties hold for any 
1 < p < oo. 

We now consider the extended domain 

C ^ilx (0,oo), 

with its later boundary 

OlC = dnx [0,oo). 

We recall from Cabrc-Tan |CTj the Sobolev space on C with zero assumption on OlC, 

Hl^{C) = {v e H^{C) : V = a.e. on OlC}, 

equipped with the norm 

1/2 

I Vwl^dxdy 



For ri > 2, it follows from the Sobolev trace inequality that 

/ f X (n-l)/2n / ^ ^ 1/2 

^Jif;(.T,0)|2"/("-i)dxj <C^j^\Vw{x,v)\^dxdyj e Hl^iC), 

where the constant C > depends on the dimension n. We set trjj be the trace operator on x {0} 
for functions in 

trow := v{x,0)t for v G Hlj^{C). 
It is well known that traces of functions are H^/'^ functions on the boundary and we thus have 

trow e H^f\n). 

Proposition 2.1 ( |CTj ). Let Vo(i^) he the space of all traees on n x {0} of functions in Hq ]^{C). 
Then we have the following properties: 

Vo{n) {u ^ tmv \ V e Hl^iC)} 

OQ 

= {we L'^{fl) I M = ^ bk(j)k satisfying ^ ^fcA^^ < oo}, 

k=l k=l 

where \k,4>k is the spectral decomposition of —A in f2 as above, with {4>k} an orthonormal basis 
in L'^{Vl). 
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Proposition 2.2 ( jCTj ). If u G Vo{^l), then there exists a unique harmonic extension v in C of u 
such that V G j^{C). In particular, if the expansion of u is written by u(x) = X]fe°=i bk4'k{x) E 
Voi^), then 

OO 

v{x,y) = ^6fc0fc(x)exp(-A^/^y) G H^^i^), 

k=l 

where \k,4'k is the spectral decomposition of —IS. in f2 as above. Let us define the operator Ai/ 2 '■ 
^ Vo*(0) by 



dv 
dv 



k2x{0}j 



where Vq{^) is the dual space o/Vo(^l)- Then 



A1/2U = ^ bkX^^^ 



k 'Pk, 



fc=i 



and A'^p is equal to —A in with zero dirichlet boundary value on dfl. More precisely, the inverse 
Bi/2 '■= ^7/2 unique square root of the inverse Laplacian (— A)^^ in with zero Dirichlet 

boundary value on dQ. 

From the above proposition we deduces the fohowing equation for a harmonic extension v. 



[ |V. 

Jnx{y=n} 



v{x,0)\^dx 



nx{y=a} 



-Axv{x, 0)v{x, 0)dx 



f2x{j;=0} 



Ai/2v{x, 0)Ai/2v{x, 0)dx 



(2.1) 



d_ 

dv 



v{x,Q) 



dx. 



lnx{y=o} 

It win be useful in the proof of Lemma p.3p . 

Now we recall the definition of weak solution of the problem involving the square root of the 
Laplacian. For the linear equation 

j A1/2U = g(x) in VL, 
I u = on dVl, 



(2.2) 



the concept of weak solution is defined in different ways in Cabre-Tan |CTj and Hulshof-Vorst 

m- 

Definition 2.3 (piVj). A function u G L^{H) is a weak solution of (|2.2p if it satisfies the following 
equation. 

(2.3) 



^i/2(m,0)= / u{-lSf'^(j) dx^ I g{x)(j)dx, 4>eHl{^). 
Jn Jn 

Definition 2.4 (fCTj). A function v G Hq ^(C) with v{-, 0) = u is a weak solution of 



in C, 

V = on OlC, 

dv 



Av = 
v = 

[ ^=9{x) onf]x{0}. 



when it satisfies 

/ VvV^dxdy={g{x),£,{;Q)), 

JC 

for all ^ G i?o Then we say that u = tr^v is a weak solution of (|2.2 



(2.4) 



(2.5) 
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Lemma 2.5. Suppose that v G Hq i^{C) is a weak solution of (j2.4|) . then u = tr^v G HQ^^(n) is a 
weak solution of (j2.2[) in the sense of Definition [ 



Proof. If u G C (C) satisfies Av = in C, wc have the following equality. 



= / Av ^ dz = - [ Vv - Vi dz+ / ^ C dx, 
Ic Jc Jn 



forany^ G C^(C). Observe that |^ = ^i/2W on and ^^Ai/2v{x,Q)^{x,Q)dx = /^^ ^(x, 0) A/2?(a;, 0) 
Thus we get 



VvVidz^ I v{x,Q)Ai/2S,{x,Q)dx. 
c Jn 

This equality holds for any v G j^{C) and ^(a;,0) := (t>{x) G H^{^) by an approximation 
argument. Then, since v satisfies (|2.5p . we get 



v{x,Q)Ai/24>{x)dx = I g{x)<j){x)dx. 
n Jn 

It means that u ~ tr^^v is a weak solution of (12. 2p in the sense of Definition 12.31 □ 



We shall use Definition 12.31 when we establish the existence of weak solution and Brezis-Kato 
type estimates in Section 4, where the proofs of it directly follows from the proof of [HVj for the 
analogue theorems for the Lane-Emden system with the Lapalcian. Then we can say that the 
solution is also a weak solution in the sense of Definition 12.41 from the existence and uniqueness of 
the linear problem (j2.4l) with using the above lemma. It will enable us to use the regularity results 
of [CT] . 

We finish the section with proving the L'' estimates necessary for the bootstrap argument 

in the proofs of Theorem 11.11 and Theorem 11.21 



Lemma 2.6. For < a < 2, we assume that u and f satisfies the equation 



Suppose 1 < p < q < oo satisfy 



^ on dfl. 



11a , , 
< -. 2.6 

p q n 



If f e LP {VI), then u G Li{Vt) and 

\\u\\,<C{n,p,q)\\f%. 
Moreover, if q oo, the above inequality holds for the case ^ ~ | = ^• 

Proof. Let Gn{x,y) be the Green function of (— A)"/^. It follows from [Si Theorem 1.1] that there 
exists a constant C = C{Vl) > such that 

Gn{x,y)<C ^ 

Thus, 

\u{x)\ - 



/ Gn{x,y)f{y)dy 
Jn 



Jnlx-yl"-" 
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Then, the Hardy-Littlewood-Sobolev inequality [Sj yields 

\\u\\Li{n) < UWlp 

for 1 < p < q < oo satisfying 

1 1 _a 
p q n 

Then Holder's inequality yields the asserted inequality for the case q ^ oo. 
Suppose now that q = oo and ^ < ^ • Since (n — a)p' < n we obtain 

< ll/lli-di)- 

It completes the proof. □ 

3. The new approach 

In this section wc prove several lemmas and establish the proof of Theorem I 1 . 1 l using the lemmas. 

For s > we set 

ris = {x en\ dist(a;,ar2) < s}. 
Lemma 3.1. Let u be a C^(jl) solution of (jl.ip with f satsifying 

\unMl^>Xy\ (3.1) 

n— >-oo u 

Suppose that is strictly convex. Then, for any s > there exists a number C ~ C'(s,p, Q) > 
such that 

f{u)dx < C, (3.2) 



sup u{x) < C. (3.3) 



Proof. Wc have 



Xi4}iudx = / {Ai/24'i)'U'dx 



/ (j)iAi/2udx (3.4) 
<Pif{u)dx. 



The condtion (|3.ip gives that f{u) > (A^/^ -I- S)u - C for some S > and C > 0. Then, the above 
inequality yields 



It gives 



Xi(f>iudx > / {\/ Xi + 5)u(f>idx — / C(j)idx. 
n Jn Jn 



[ (f>iudx<l [ C<j)idx <C{S,n,f). 
Jn Jn 
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Because (pi > c(s, 17) on 17 \ 17s, we have 



udx < / (piudx < 1. (3-5) 
n\ns Jn 



From the identity p.4p . we obtain the estimate p.2p . 

Since 17 is strictly convex, the moving plane method in |CT[ p. 2091] yields that the solution 
increases along an arbitrary line toward inside of 17 starting from any point on 917. Then, it is well- 
known that the estimate p.Sp gives the uniform bound near the boundary(see e.g. |QS[ Lemma 
13.2]). It completes the proof. □ 

Remark 3.2. In fact Lemma [3.11 holds without the convexity condition. In the proof of Theorem 
11.11 we shall prove it by using the Kelvin transformation in the extended domain. 

In the case of the classical problem (|1.5p . if one has the L°° bound (|3.3p near the boundary, one 
can use W^'^ estimate for the equation (|1.5p on a localized domain near the boundary 917 to get a 
uniform estimates of ||^| on the boundary 917. Then, for f{u) = u^, p < the Pohozaev 
identity 



dn 



(x,^)da=(-^-^^) / uP+'dx 



gives a uniform bound of u^'^^dx. 

However, the Pohozaev identity for the problem (jl.ip is given in the extended domain 17 x [0, oo) 
as follows (see [Tl Lemma 3.1]). 

|V«p(z,z.)da= f-^-^) / Iv^'dx, (3.6) 



2 JdLC VP + 1 2 / jax{o} 

where v is the harmonic extention of u. In this formula, the left-hand side would not be bounded 
by using only the L°° estimate of u{x) = v{x, 0) near 917 since the harmonic extension v{z) consists 
of all values of u{x) on 17. Nevertheless, we shall get the bound of the left-hand side by using both 
the L°° bound (|3.2p near the boundary and the bound p.3p away from the boundary. For this 
we split the source of the equation 

Av^O in C, 

V = on 9lC, 

fi - fiu) on 17 X {0} 

in the following way: 

f{u){x) = f{u)x{x) + f{u){l-x{x)), 

where x is a smooth bump function supported in 17 \ 17^ and x = 1 on 17 \ 1725 with a small number 
S > 0. We recall that the linear problem 

Aw = in C, 

v = on 9lC, (3.7) 

|i = g{x) on 17 X {0} 

has a unique solution v G j^{C) for each g e iJ^/^(17)(see |CT1 p. 2069]). Thus, there exist 
solutions vi and V2 such that 

Aui =0 in 17 X (0,oo), 

wi = on 917 X [0, oo), 

= f{u){x)x{x) on 17 X {0}, 
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and 



Av2 =0 in X (0, oo), 

V2 =0 on 9X1 X [0, oo), 

[ ^=f(u)ix)il^xi^)) onnx{0}. 

Then the function vi + V2 satisfy 

A(wi + V2) = Awi + Av2 = in C, 

vi + V2 ~ on 9lC, 

= + f{u){l ~ xi^)) - f{u){x) on 17 X {0}. 

It follows from the uniqueness that v = vi + V2. We thus have 





dv 


/ 


dv 



{z,v)da < 2 



dvi 



dv 



(z, v)da + 



5W2 



dv 



{z, v)da 



(3.8) 



In order to estimate each term in the right-hand side, we shall prove the following two lemmas. 

Lemma 3.3. Let g £ L'^{n). Suppose that u e Hl^{C)nL°°{C) is a weak solution of the following 
linear problem: 



Au = in C, 
u = on OlC, 

^=g on nx{0}. 

Then, there exists a constant C = C(ri) such that 



(3.9) 



du 
ou 



{z,v)da < C / \gix)\^dx. 



(3.10) 



Proof. We recall the well-known identity: 



div< (z, Vw)Vu — z ■ 



n + 1 



1 iVuM = 0. 



Integrating this over x (0, R), then by the divergence theorem we have 

(z, V2;u)(Vit, v)dx 



Vu\'^{z,v)da + 
dnx{o,R} 

n + 1 



- 1 



nx{y=a} 
\\7u\^dz 



+ 



I 

Jnx{y=R} 



{{x, Vxu) + RdyUjdyU — R 



(3.11) 



\Vu\ 



dx = 0. 



To show that the last term in the left-hand side goes to zero as i? — >■ 00 in a sequence, we take for 
/c e N a number Rk £ [2'', 2^"+^] such that 



/ 

We then see from fo^/n ^ 

Jilx (0,00) 



VmI dx 



inf 



Vu\'^dx < C that 



WluY-dx. 



Rk 



Wurdx < 



nx{y=R^} 



ax{2'»<y<2'= + i} 



as fc — ?► 00. 
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Observe that the last term of p. lip is bounded by a constant multiple of R /f2x{j/=_R} I'^'U'l'^dx. 
Therefore, by taking R = Rk in (|3.11l) and letting fc — > oo we get the following formula 



aox(o,oo) 



Qx{0} 



(.T, Va;U)(Vu, l/)dx — 



nx{o} 



n- 1 
2 

71-1 



\\/u\'^dxdy 

J"2x(0,oo) 

u{g{x))dx. 

Ox{0} 



In order to prove p.lO[) it is enough to bound the right-hand side by a constant times /fj^jo} \f\'^^^- 
For the first term, wc use the formula (|2.ip and (|3.9p to obtain 



Ox{0} 
< 

< 



{x,\7,^u){g{x))dx 

/ \V^u{x,0)\'^dx 

[ \^uix,0)\^dx 
Jnx{a} ov 



1/2 



1/2 



nx{o} 



\g{x)\'^dx 



\g{x)\'^dx 



1/2 



1/2 



\g{x)\^dx 



Ox{0} 

To bound the second term, we use the Soboev inequaliy ||u||^2(q') < || Vit||£,2(f2') and to deduce 

u{x)g{x)dx 



Jix{0} 

< 

< 
< 



J2x{0} 



u{x)^dx 



1/2 



Ox{0} 



{g{x)Ydx 



1/2 



J2x{0} 



\y xu{x)\'^dx 



1/2 



nx{o} 



{g{x)fdx 



1/2 



J2x{0} 



{g{x)fdx 



The lemma is proved. 



□ 



Lemma 3.4. Let g G and suppose that g has support in Q, \ Q,s for some s > 0. Then 

there exists C — C{s,n) > such that a waek solution u G Hq j^(C) H L°°{C) of the problem p.9p 
satisfies the following estimate 

2 y . -^2 

{z,v)da < C{s,n) / \g\dy 



du 



Proof. Consider the Dirichlet-Nuemann problem 

Au = in C, 



u = 



on BlC, 



(3.12) 



■§^u = g on f7 X {0}. 



For the mixed problem like the above equation, Taylor-Ott-Brown |TOB| proved existence of 
the Green function if the whole domain C is bounded. One can see that, the proof of |TOBi 
Theorem 3.6] use the boundcdncss assumption of C only to have the coercivity estimate ||ft.||L2(c) < 
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C||V/i 11^2 ((;;■) for any function h vanishing on the boundary with Dirichlet condition. On the other 
hand, for the domain C = ft x (0, oo), wc can use the Sobolev inequahty in each sUde ft x {s} for 
< s < cx) to duduce that 

\\h\\mc) < C\\VMl-{C) < C\\Vh\\L2ic) 

for function h vanishing on OlC = dft x (0, oo). Thus the coercivity estimate holds and it guarantees 
the existence of a unique Green function Gi for the problem (|3.12[) . We then have the foUowing 
expression 



u{z) 



Gi{z,v)f{y)dy. 



(3.13) 



In order to find an upper bound of Gi we shall use the Green function G on M" = {x = 
(xi,-- - ,a;„+i) e W\xn > 0} with the Neumann condition on dft = {x : a;„ = 0} which is 
given by 

1 1 



where y* = {yi 



^^^'^^ (n - 2)cr„|z - ' (n - 2)(T„|z - -u;*|"-i ' 

• ,2/n, -yn+i) for y = (j/i, • • • ,y„+i)- That is, it satisfies 



AG(z,u;) =(5^(z) 
i:G{z,w)^0 
G{z,w) > 



in C, 

on 17 X {0}, 
on OlC. 



On hand, the Green function Gi satisfies 



AGi{z,w) = Sw{z) in C, 
|;Gi(z,u;) = onf]x{0}, 
Gi{z,w) = on OlC. 

Then, applying the maximum principle |CT[ Proposition 4.4] to G — Gi, we conclude that 

Giiz,w) < G{z,w). 

In order to prove the lemma, we need to estimate ^{z) = J^^ ■^Gi{z, y)f{y)dy which involves the 
derivatives of Gi{z,y) for z G OlC. To use the regularity property A^Gi = on an open domain, 
we shall use the identity p. lip of u on OlCt for < r < s: 

2 , , 

(3.14) 

Vu\'^dxdy = 0. 

O,,x{y=0} 

on fir X {y = 0}. As for the last term, 
we use an integration by part with the fact that u = on dVl x [0, oo) to get 

du 

ix + I u 



(z, v)da:, + ]- i 
^ Jd 

(x, V xu){\/u, v)dx 



ao,.\af2x(o,o( 
n- 1 



First we note that the third term is zero because ^ 



/ 



\Vu\^dxdy = 



/nrx(o,oo) 

Then, the identity (fSTi]) gives the following identity. 
\ I \Vu\\z,u)da=\ f 



ao,.\anx[o,oo; 



u—da. 



\Vu\^{-z,v)da + 



n — 1 



9f2r\aax(o,oo) 



du 
u—da. 
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We now set Cr := (fi \ ^r) x [0, oo) and integrate the above formula over s/4 < r < s/2, then we 
can deduces the foUowing incquahty 



i / \VuWz,i^)da=- [ 



< 



/2\f2s/4X(0,Oo) 

[|Vup dz. 



|Vitp(-z, v) + {n- l)u— \ da 



(3.15) 



'Ca/2\Cs/4 

Using the formula p.l3p and Cauchy- Schwartz inequality, we get 

2 



|Vu(z) 



< 



\7^Gi{z,y)g{y)dy 
\V.G^{z,y)\^\g{y)\dy] I / \giy)\dy 



Therefore, 



C3/2\Cs/4 
< 



[|Vup +1*2] dz 



|VGi(z,y)|2 + |Gi(^,y)P d2 



9iy)\dy / 



(3.16) 



(3.17) 



In order to bound the term involving VGi, we shall use the following result. 

Sublemma 3.5. Let A be a smooth bounded domain. Suppose that v satisfy the equation. 

J Au = on Ax [0,oo), 
\ £v^Q on Ax {0}. 

Then, for each S > 0, there exists a constant C = C'{A, S) > such that 

/ / \\7r,v{x,s)\'^dxds < C / \v{x,s)\'^dxds. 
Jo Ja\As Jo J a 

Proof. Let (f) he a positive bump function compactly supported on A which equals 1 on As and 
satisfies 



\V^(l){x)\'^ <C(j){x) VxeA, 



(3.18) 



where the constant C > can be chosen depending only on 6 and A. Using Aw = 0, an integration 
by parts gives 

d 







J A 



Av ■ v(x, s)(f)(x)dxds 



A dv 



v{x, s)v{x, s)4>{x)dx 

VxW • Va;w(x, s)4>{x)dxds 
VxV ■ v{x, 3)^ x4'{x)dxds. 



J A 



J A 



Note that = in this identity and use Young's ineqaulity to get 

Vxv{x^ s)\^ (f){x)dxds 

VxV • w(.T, s)'S/x4'{x)dxds 

/•oo /> /• 00 /• 

/ / C\v{x,s)\ dxds + / / 77^|V2,w(a;, s)\^\Vx(f>{x)\^dxds. 
Jo J A Jo J A 46 



J A 



< 



J A 

QO 
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Using p.lSp we obtain 



\7^v{x,s)\'^(j>{x)dxds < C{S,A) / / \v{x, s)\'^dxds. 

JA Jo J A 



□ 



Now we choose A = \ ^s/ie ^-i^d take a bump function </> such that (/> = 1 on r2s/4 \ f^s/s 
satisfying p.lSp . Then we get 

/ / \VGi{z,y)\^da,ds< [ [ \Gi{z,y)\^da,ds 

Js/S<r<s/4 JdLCr\dLC Js/16<r<s/2 J dLCr\dLC 

^ [ I (| \;[zifda,ds 

Js/16<r<s/2JdLCAdLC \z ' Vl (3.19) 
1 



<1 



(s/2+|z„+i|)2("-i) 



n-1) "-^-^ 





du 


/ 





where the third inequahty holds because y £ J7 \ fis and z £ ^ [Oi oo)- Using this with p.lSp 
and (|3.16p we deduces that 

(z,!^) da<C{s,n) (^Jjg{y)\dy^ , 
which is the asserted inequahty. □ 

Proposition 3.6. Suppose 1 < p < ^^^j and u G C'^{C) is a solution of the equation (|l.ip with 
f{u) ~ uP . Then there exists a constant C = C{p, Q) > such that 

uP+\x)dx < C. 

n 

In the general case of Theorem ] 1. 11 there exists a constant C ~C{f,^l) > such that 



ny.{0} 



71—1 

nF{v) - -^vf{v) }dx<C, 



where F{v) :— J^^' f{s)ds. 

We are now ready to prove the bound of LP'^^^fl) norm of the sokition u. 



Proof of Proposition \3.6[ In this proof, we assume that fl is strictly convex. The general case will 
be proved in the last part of the proof of Theorem 11.11 

We first make use of Lemma [3TT] to get a number s > and a constant C = C{s, ft) > such 
that 

sup u{x) < C (3.20) 

and 

/ f{u){x)dx < C. (3.21) 

We find a bump function x supported in il \ Hs and x = 1 on \ ^2s- Set v be the harmonic 
extension of u. Then v satisfies the equation (|1.2p . We split the function v as v ~ vi + V2, where 
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vi and V2 satisfy the following equations 



Avi ^0 in C, 

vi — on OlC, 



and 



Av2 =0 in C, 

V2 = on 9lC, 

I ^=x{x)f{u){x) onC!x{0}. 

Using Lemma [3731 and p.20p we get 

2 



9i,C 



9:/ 



{x, v)da 



< 



\{1-X{x))f{u){x)fdx<l. 



On hand, we use p.2ip and Lemma to have 





dv2 


/ 


dv 



(x, v)d<T 



< 



< 



< 1. 



\{xix)fiu)ix))\dx 
\f{u){x)\dx 



(3.22) 



From p.Sp and the above two inequalities, we get 

2 

(x, i')da < L 

Then the Pohozaev identity (|3.6p concludes the proof. 
Now we are in a position to prove our main theorem. 





du 


/ 


dv 



□ 



vroof of Theorem l 1 . 1\ For simplicity, we shall first prove the theorem for f{u) = with the 
convexity assumption on il. Since p < we get qi > p for ^ ^ ~ n ~ ^ with sufficeintly 
small e > 0. Using Lemma [2761 we get 

\\uh. < \\{-Ay/ME±i 

p 

V 

For fc > 1, we define by the relation -^^ — ^ — — e and stop the sequence when we have 

Qfc + l ^ 

-^^ < — — e. Then, using Lemma 12.61 we have 

< ||(-A)V2^||^ 

p 

< 1, 

for A: = 1, ■ • ■ , A'' — 1. We then have llitjlg^ < 1, and use Lemma [2.61 again to deduce ||u||L°t ^ 1- 
It completes the proof when ^l is convex and f{u) = u^, p < ^^zzj- 
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In order to prove this for general / satisfying the condition (1), we first see from Proposition 
that 

/ \nF{v)-^^^vfiv)\dx<C. (3.23) 

From the condition (|1.3p . for any e > 0, we can find Ce > such that 

uf{u) < 0F{u) + eu2/(w)^/" + C,, (3.24) 
In the below, Cc may be chosen differently in each line. We note that 

u'\fiu)\idx < Ikll^. 11/(^)11}/" < C\\A\%u\\l (3.25) 



and 



/ uf{u)d. 
Jn 



\x — I uAi/2udx 
n 



Al/lu-A\/ludx (3-26) 



From p.23p and p.24p . we can deduce that 
'n n — V 



uf{u)dx<- / u'fiufdx + C,. 
Jn 

Choose e = eiO,n) > smaU enough so that (f - ^) > |. Then combining ([3^ and ((3?26)) 
with the above inequality yields that 

W//lu\\l < c, 

for a constant C ~ C{9,n) > 0. 

Let p > 1 and {p+ 1);^. Then, 



<C [ iVu^pdx 

Jnx(o.oc) 



= Cp [ Vm • '^{uP)dx 

jnx(o,oo) 

= C'p /" — ■ u^dx 
Jo 9i/ 

< eCp / u^u^dx + Ce- 
Jn 



(3.27) 
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Since p + 1 = ^^^g we have 



< 



< C 



< C 



'dx 



(3.28) 



For a sufBciently small e > 0, the above inequaliy and p.27p yields 



i'^dx 



1/9 



Since p is an arbitrary number, we can use Lemma 12.61 to conclude that 

\\u\\l^<C,. 

It completes the proof for general / with the convexity assumption on D,. 

Finally, we shall remove the convexity assumption by using the Kelvin transform in space 
to V. Since is smooth, for a point xq we can find a ball which contact xq from the exterior of fl. 
We may assume xq = 1 and the ball is B{0,1) without loss of generality. Set 

w{z) = 

Then, w satisfies 

( Aw^O in k(C), 

w > in k{C), 

w = on K{dfl X [0, 00)), 

I ^ = g{y,w) onKinx{0}), 

where g{y,w) :— f{\y\^~^w)/\y\"'^-^. For A > we set 

• Da = k{C) n {z G M"+^ : |z| < 1, zi > 1 - A}, 

• dDx^ DxndRl+\ 

• Tx{y) = (2-2A-2/i,y2,--- ,yn+i)- 

Let Ca = wa — w defined on Dx- We claim that wa > if A > is sufficiently small. Set 
— max{0, —v\}. Then, 







C;^ ACxdxdy 



-Da 



/ (^^dx+ f \VCx\'dxdy 



(3.29) 



We have 



(-Ca ){9{Txx, wx) - g{x, w))dx 



(3.30) 



dD^n{w^<w} 



{w - wx){gix, w) ~ g{Txx, wx))dx 
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Since u -> f(u)u is nonincreasing, we see that g{x,w) < g{T\x,w\) because \x\ > \T\{x)\. 
Using this we deduces that 

/ \^C,x?dxdy<l {w -wx){g{x,w) - g{x,wx))dx 

JDx JdDxn{wx<w} 

< / {w - wxfh{x,w,wx)dx (3.31) 

J dDxr\{wx<w} 

{Cxfh{x,w,wx)dx, 

dDxn{wx<w} 



where h{x, w, wx) — ^ . Since / is locally Lipschitz it is bounded by using sup^j^^ [\w\ 



(3.32) 



g{x,w)-g{x,wx) 
w — wx 

\wx\]- By Holder's inequality we deduce that 

/ \V(:x?dxdy<C [ iCxfdx 

JDx J dDxn{wx<w} 

< c\dDx n {wx < «^}r/"IICr(-,o)||iw(.-i)(o)- 

Using the trace inequality, we get 

\\Cxi-,mL^-n^-^Kn) < C\dDxn {wx < w}\'^^C^i-,0)\\l^^^^^ 

which yields that = for small A. 
Now we set 

r, = sup{X > : Tx{Dx) C n{C)}, 

and 

^ {0 < A < I : Ca > onDxjU {0}. 

We shall prove that S ~ [0,7^/2]. Since (^x is a continuous function of A, S is closed. Thus, It 
suffices to show that S is also open in [0,77/2]. Note that the constant C in the inequality (|3.32p 
can be chosen uniformly for A e [0,77/2] since supg^;^^,j/2 sup^^^ [|i(;| + |wa|] is bounded. 

Choose any < Aq < 77/2 contained in 5*. Then we have (xg > 0. Since (xg > on K{dQ x 
[0, 00)) n Dxo and A^Ao = in Dxg, we see that Cao > in Dx„ by the maximum principle. Thus 
we can find c > such that 

li^Ao.c := {x e Dxg : Cxo > 41 > I-DaoI - S/2. 

By continuity, there is e > such that Ca > f and \Dx \ -Daq I < f for A G [Aq, Ao + e). For such A 
we then see that 

\{xeDx:(:x>^}\>\Dx\-l-^^ = \Dx\-S. 

This yields that 

\{x eDx:Cx< 0}| < 5. 

Then the inequality p.32p implies that Ca > for A G [Aq, Ao + e). Therefore we have that w 
increase in any line in 17 starting from a boundary point. Since w{x) > w{y) we deduce that 
7i(a;/|a;|^) > cu{y/\y\'^) holds with some c G (0, 1) uniformly for {x,y) satisfying min(|a;|, \y\) > 1/2. 
Then we can obtain the L°° bound near the boundary d^l. The rest of the proof is same with it 
of the restricted case. The proof is completes. □ 
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4. The Lane-Emden system 

In this section, we study the Lane-Emden system involving the square root of the Laplacian 

A]^I2U = in C, 

= ui in C, 

u > 0, V > in C, 

u ~ V = on dC. 



We shall use the same letter {u,v) to denote the harmonic extension of a solution {u,v) of (|4.ip . 
Then, we have 

Au = Au = in C, 

u = v = on 9lC, 2n 

1^ = 1^ = u9 on 17 X {0}, ■ 
M > 0, u > in C. 

We say that (p, is 

(1) subcritical if -1_ + > n^, 

(2) criticalif ^ + ^ = ^, 

(3) supercritical if ^ + ^ < 

First, the existence of weak solution and Brezis-Kato type estimate will follow from the same 
proof of |HVj . We shall obtain a Pohozaev type identity, which proves nonexistence of nontrivial 
solutions for the system (j4.ip in critical and supercritical cases. Next, we shall establish a moving 
plane argument. Then, we shall finally prove a priori estimate for subcritical cases by applying the 
method which of the proof of Theorem 11.11 

The following two theorems are analogous to the result on the existence and Brezis-Kato estimate 
for the Lane-Emden system (see |HV1 Theorem 1]), where the subcritical range is given by 

1 1 n- 2 

> 



p+l g + 1 n 

The difference of the range of (p, q) comes from the different ranges of sobolev embeddings. With 
only changing the index of the embeddings we can apply the proofs of |HV| straightforwardly to 
obtain the following theorems. 

Theorem 4.1. If{p,q) is sub-critical, one can find a, 13 > satsifying 

1 1 a 1 1 /3 ^ ^ ^ 

— r < o TT < ~' ""'^ a + 13 = 1. 

2 p+l n 2 ?+l n 

Then, there exists a (nontrivial) weak solution {u,v) G Hq{D,) x Hq (D.) of the system (|4.ip . 

Proof. See the proof of |HV1 Theorem 1] . The only difference of the range of {p, q) is due to the 
different ranges of the Sobolev inequalities. □ 

Theorem 4.2. Assume {p,q) is sub-critical or critical. Let {u,v) be a weak solution of the system 
(|4T|) . Then, u G C^-" and v 6 C^^" for some 0<a<l. 



Proof. One may see that the proof of jHV[ Theorem 3.1] can be adapted to our problem with using 
the embedding in Lemma [2761 thus we have u E L°"{il) and v 6 L°"{il) for subcritical case. Then 
we can apply the regularity result |CT[ Proposition 3.1] to get u G C^'"(r2) and v G C^'"(r2). □ 
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We shall obtain a Pohozaev type identity for the system. It will gives the nonexistence result 
for the critical and supercritical cases. 

Theorem 4.3. Suppose that {u,v) G C^(C) x C^{C) satisfies 

i Au = Av = inC, , , 

\ u = V = U 011 OlC 

Then we have 



(4.4) 

[(x, Vj;ij)(V,i/) + (x, Vj;'u)(Vw,i/)]da; - (n - 1) / Vu-Vvdx. 



/nx{v=o} 
Proof. We have 

div[(x, \/v)Au + {x, Vu)Av] 

(4.5) 

(x, \7v)Au + (x, Vm)Au + X ■ V(Vm ■ Vw) + 2Vm ■ Vv. 
Therefore, from (|4.3p we have in C that 

div[(x, Vw)Vu + {x, Vu)Vw] = x ■ V(Vu • Vu) + 2Vu • Vw. (4.6) 

We have 

div[(x)(VM • Vw)] = (divx)(Vu- Vu)+a:-V(Vu- Vw) 
= (n + 1)(Vm • Vu) + a; • V(Vw • Vu). 

The above two formulas gives the following equality. 

div[(a;, Vv)Vu + {x, Vu)Vv] - div{x{Vu ■ Vw)) + {n - l)Vu -Vv = 0. (4.7) 

The divergence theorem with that u = v = on dfl x [0, oo), we get 

/ div[{x,\/v)\/u + {x,'Vu)\7v]dx 

Jnx{o,R} 

du dv (' 

2{x-v)— ■ —da+ I [{x,V.^v){Vu,v) + {x,V:,u){Vv,v)\dx (4.8) 

ox(o,i?) av Jnx{y=o} 

[(x, \'^v){\7u, v) + (x, V^u)(Vw, z/)]da; 
and 

/ <liY{x{\Iu-Vv))dx= f {x-v){^-^)da+ [ R{Vu-Vv)dx. (4.9) 

Jnx{0,R) Jdnx{0,R) Jnx{y=R} 

By a limiting argument used in the proof of Lemma 13.31 we obtain 
div[(a;, Vf )Vw + {x, \/u)Vv]dx 

r du dv f (4-10) 

= / 2{x ■ v)— ■ —da + / [(x, V:,u)(Vu,j/) + (x,V^it)(Vi;,i/)]rfa; 



and 



/ div(2;(Vu • Vv))dx = fix- v){^ ■ ^)da. (4.11) 
Jc Jc 
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We integrate (|4.7p over C, and use the above two formulas to have 

Ou dv f f 

{x ■ v)— ■ —da + I [{x^V xv){'\Iu,v) + {x,V xu){Vv,v)\dx ~ {n — \) I VuVvdx, 

OV Jnx{y=0} Jc 

which is the desired identity (|4.4p . □ 

Theorem 4.4. Assume that the domain Q is bounded and starshaped, and p,q > 1 satisfy 

1 1 n - 1 
< . 



p+1 q+1 
Then (|1.6p has no positive solution. 

Proof. Wc may assume that CI is starshaped with respect to the origin, that is, (x • i^) > for any 
X G Ol^. It easily implies that {x ■ i/) > holds also for x G OlC. 

Suppose that {u,v) € C^(C) x C^(C) satisfies (|1.6p and denote also by {u,v) the harmonic 
extension of {u,v). Let f{v) = and g{u) = and set 



F{v) = / f{s)ds and G{u) = / g{s)dx. 
Jq Jo 

Because F{0) ~ and u = on dCl x {0}, we get 

{x,\/xv)(Vu,i')dx / {x,\/ xv)f{v)dx 

f2x{0} Jf2x{0} 



(4.12) 



Likewise, we have 



[x, ^xF{v))dx = nF{v)dx. 

f2x{0} JQx{0} 



{x,V xu){y v^v)dx = — I nG{u)dx. 
ox{o} Jnx{o} 



For a solution {u, v) of the system (|4.ip . we get 
1 /■ , .dudv 



(^^^ - (n - + (^-^ - (n - 1)(1 - 0)^ u^+irfx. 



(4.13) 



/ox{y=0} VP + 1 

Since u = w = on OlC wc have ^ > and ^ > on OlC. If (p, 5) is super-critical we can find 
9 G (0, 1) such that 

77 77 

-(n-l)6l<0 and (n - 1)(1 - 61) < 0. 



p+1 q+1 
It implies that u = v = Oonilx {0}. In the critical case, we have 



If , .dudv^ 
2 Ja^.c i^f^ i^f^ 



'OlC 

which implies that §^(2:0) = or ^{xq) = 0. Since Au = Av = 0, u,w > on C, it follows from 
Hopf 's lemma that u = or w = 0, which yields that u = v = 0. It completes the proof. □ 

Next, we shall establish the moving plaine argument, which will gives the symmetry result and 
the L°° bound near the boundary of positive solutions to (|4.ip . As a preliminary step of it, we 
need the following lemma. 
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Lemma 4.5. Assume that c < 0, d < and ^ is a bounded (not necessary smooth) domain o/M" 
and c,dG L°°{n). Let u,v € (C) Ci L°° (C) , where C = 17 x (0,oo), satisfy 

Au ~ Av = in C, 

a (4.14) 

^ + c{x)v>0 on nx{0}, ^ ' 

f^+d(a;)w>0 on 17 x {0}. 

Moreover, we assume u{xq) = ^(a^o) = holds for some point Xq £ C. Then, there exists S > 
depending only on \\c\\i^,x(^fi-j, \\d\\L°° and n such that if 

\nr\{ui-,o) < o}| • |f7n {w(-,o) < o}| < s, 

then u > and v > in C. 

Proof. Let — max{0, — li} and ~ maxjO, — w}. Since = = on dfl x [0, oo), we see 

0=1 Audxdy = ( u^^—dx+ [ \\7u^\^dxdy. 
Jc Jnx(o\ ov Jr 



Then, using c < wc deduce that 

/ \Vu~\^dxdy = - / 
Jc Jn 



/Slx{0} 



„ du 
V -7— ax 
ov 



u cvdx 

!^x{o} (4.15) 



< / u {—c)v dx 

<|r!n{«-(-,o) >o}|i/"||c|Uoo(f,)|i 

By the same argument for , we get 

\\7v-\'dxdy < |17n^-(-,0) >0}|i/"|MIU»(n)h-|L2„/(,.-i,(jj)-||z;-|Lw(n-i)(n)(4.16) 
Multiphying the above two inequahties, we obtain 
J \\/irfdxdy^ (^J \Vv^\'^dxdy^ 

< |nn{u-(-,o)>o}|i/"|i7n{i;-(-,o)>o}|i/"||c|U»(^,)||4i^(^,)||u-||2,„,,„_,,^ 



(4.17) 



We now use the Sobolev trace inequahty 

'5o||w"(-,0)||^2„/(„-i)(o) < \Vu-fdxdy 

and 



So\\v (•,0)||^2„/(„-i)(n) 



< J \ Vv~\'^dxdy. 



Then it follows that 

-i2|i ,-/ riM|2 



5o1|u-(.,0)|!i.„/<„_„(^)||z;-(-,0)|!i.„/<„_„(,,) 

< \nn{u-{.,o) > o}\'/^^\nn{v-{-,o) > o}\'^-\\ch^^a^^^^^^ 

If we choose S so that > (5^/"||c||ioo(f2) the above inequality yields that = or 
= 0. Say = 0, then we have \\7v^\'^dxdy = from (|4.16p . Thus we have Vu^ = 0, and 
since v{xo) = 0, we conclude that = 0. It completes the proof. □ 
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For y G dVt and A > we set 

T{y,X) :={xeM" : {y - x,u{y)) = \}, 

S(2;,A) ■.^{x^n:{y-x,v{y))<\], 

and define R{y, A) be the reflection with respect to the hyperplane T{ij, A). We also set A) := 
R{y,X)j:{y,X) and 

Xy := sup{A > : A) C Q}. (4.18) 

Lemma 4.6. Suppose that {u,v) £ C^(f2) is a solution of p.6p . Then, for any y e 917 anrf 
X G S(?;, A) f/ie following inequalities 

u{R{y, X)x) > u{x), v{R{y, X)x) > v{x) 

holds for any A 6 (0, Aj,]. 

Proof. We may assume that G 9f2 and = (1, 0) is a normal direction to 3il at this point. It is 
sufficient to prove the lemma at this point. For A > we set 

Sa = {{xi,x') e ^ : xi > X} and Tx = {{xi,x') e 51 : xi = A}. 

For X E J^x, define xx = (2A — xi,x'). From the defintion (|4.18p we see 

{xx:xe Ea} C O VA < Aq. 

We denote also by (w, u) the harmonic extension of {u,v) in C. Then, {u,v) G C^(C) satisfies 

Am = Au = in C, 

u ^ V ~ on 9lC, 



on 17 X {0}, 



(4.19) 



dv 

u> 0, V > in C. 

For {x,y) G Sa x [0, oo), we set 

ux{x, y) = u{xx,y) = u{2X - xi,x' , y) 

and 

ax{x,y) = {ux - u){x,y), f3x{x,y) = {vx - v){x,y). 

Then we have ux = vx = on Tx x [0, cxd) and obtain from (|4.19p that ua > and vx > on 
{dn n Sa) X [0, oo). Since dT^x = Ta U {dfl n Sa) we see that {ax,Px) satisfies 

AttA = Al3x = in Sa X (0, oo), 

ax>0, Px>0 on {d^x) x (0,oo), 

^ + ca(x)/3a =0 onI]Ax{0}, 

^+dxix)ax^O onI]Ax{0}, 



where 



cx{x,Q) = — ^ and dx{x,Q) - ^ 



Vx — V Ux ~ u 

Note that ca < and dx <Q- Now we choose a small number k > so that the set Sa has small 
measure for < A < k. We then deduce from Lemma [4.141 that 

QfA > and /3a > in Sa x (0, oo), VA G (0, k). 
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The strong maximum principle induces that ax and /3a are identically equal to zero or strictly 
positive in T,\ x (0, oo). Since A > 0, we have a\ > and /3a > in {dfl n 9Sa) x (0, oo), and thus 
we deduce that ax > and /3a > in Ea x (0, cxd). 

Wc let Ai = sup{A > 0|aA > and /3a > in Sa x (0,oo)}. Wc claim that Ai = Aq. With 
a view to a contradiction, we suppose that Ai < Aq. From the continuity, we have a^-^ > and 
/3ai > in Sai X (0,cxd). As before, from the strong maximum principle, we have that a\-^ > 
and /3ai > in Saj x (0, oo). Next, let J > be a constant and find a compact set K C Eai such 
that IEai \ K\ < 5/2. We have a\-^ > yU > and > rj > in K for some constant 77, since K is 
compact. Thus, wc obtain that q;ai+£(-, 0) > and l3\^+e{-,0) > in A' and that |EAi+e \ A'| < (5 
for sufficiently small e > 0. 

By using Lemma [4. f 41 in Eai+e x (0, 00) to the function (aAi+e, /3Ai+e), we have that q;ai+c > 
and /3Ai+e > in K. Thus {aA^+e < 0}, {/3Ai+e < 0} C Sa^+c \ K, which have measure at most S. 
We take 5 to be the constant of Lemma [4. 141 Then we deduce that 

Q!Ai+£ > and /3Ai+e > in Y^x^+e x (0, 00). 

This is a contradiction to the definition of Ai. Thus, wc have that Ai = Ao, which proves the 
lemma. □ 

This lemma gives the following symmetry result. 

Theorem 4.7. Suppose that a bounded smooth domain CI C M" is convex in the xi direction and 
symmetric with respect to the hyperplane {xi ~ 0}. Let {u,v) be a C^(f2) solution of (|4.1|) . 

Then, u is symmetric in xi direction, that is, u{^xi, x') = u{xi,x') for all {xi,x') £ Q. 
Moreover we have < for xi > 0. 

We are now ready to prove the main theorem. 



Proof of Theorem Since fl is convex and smooth, there exist constants Ao > and co > such 
that 

!]'(?/, A) C 17, A<Ao, and (i/(a;), > Cq, x G dJ:{y, Xq) Ci dn. (4.20) 

If {p, q) is subcritical, we may choose 6 G (0, 1) so that 

TL n 

1)61 > and (n- 1)(1 -61) > 0. 



p+1 q+1 
Then we get from the identity (|4.13p that 



/ (vP+'+u'^+Adx<C{p,q,n) [ (x.^)^J^da. 

Jnx{v=o}\ ) JdLC ovdv 



Multiplying 01 in the equaions of (|1.6p we have 



v^(f>idx — / XiU(pidx and / u''(f>idx = / Xivcjyidx. 
! Jn 

We use a convex inequality to get 

XiU(j)idx > ( / v(f>idx)^ 



and 

XiV(f>idx > ( / u(f>idxy , 



which yield that 



Also we have 



/ v(j>idx < C and / u(j)idx < C. 



(yP + u'i)cj)idx < C. 

From (|4.20p . Lemma [4.61 and the above inequality, we can obtain L°° bound for near the 

boundary dU,. Then, using Lemma l3.3l and Lemma 13.41 we get 

2 

da < C. 





du 


2 


dv 


/ 


dv 


+ 


dv 



Using Cauchy-Schwartz inequality, wc get 

dudv 
yX ■v) — —da <C. 

Thus we obtain 

' [vP+^ + u'^+^)dx < C. 



We now use the bootstrap argument to improve the integrability of v and u. For this, we need 

< — and ^ — - — ■ ^ — -— r < — . 



(p + l)p' {q + n {q + {p + l)p'+i n 

It is enough to get 

< — and — < 



p+1 {q + l)p n g+1 n' 

We need to choose p so that 



1 

— > max 
P 



{q+l)[ — 



Because + ^^-j- = + e, we may choose p so that 

1 

- > 1 — emnifp +l,q + 1). 
P 

It enables us the iteration, and so completes the proof. □ 
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